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IN THE UNITED STATES DESIGNATED/ELECTED OFFICE 
OF THE UNITED STATES PATENT AND TRADEMARK OFFICE 
UNDER THE PATENT COOPERATION TREATY-CHAPTER II 

PRELIMINARY AMENDMENT A 
PRIOR TO ACTION 

APPLICANT(S): WALTER AIGNER ET AL 

ATTORNEY DOCKET NO.: P01 ,0104 

INTERNATIONAL APPLICATION NO: PCT/EP99/06842 

INTERNATIONAL FILING DATE: 16 SEPTEMBER 1999 

INVENTION: METHOD FOR DETERMINING THE POSITION OF 
TEXT LINES IN TEXT RECOGNITION TASKS 

Assistant Commissioner for Patents, 
Washington D.C. 20231 

Sir: 

Applicants herewith amend the above-referenced PCT application, and 
request entry of the Amendment prior to examination on the United States 
Examination Phase. 

IN THE CLAIMS : 

On amended page 9: 

replace line 1 with --WHAT IS CLAIMED IS:--; 

Please replace original claims 1-3 with the following replacement claims 1-3, 
referring to the mark-ups in Appendix A. 

1) (Amended) A method for determining the position of text lines in text 
recognition tasks, comprising the steps of: 

determining a brightness distribution of an acquired Image excerpt along a 
vertical by histogram formation along said lines; 

smoothing said brightness distribution is smoothed; 
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determining a maximum value and a minimum value of a function obtained in 
this way; and 

calculating thresholds that serve as a basis for distinguishing between text 
line and text interspace calculated based on these extremes; 

ascertaining a line interspace when said function has a combination of a 
maximum with a minimum in which said minimum has a value of less than 

function minimum + number of pixels over the width of the image excerpt/1 5 + 
2*number of pixels over the width of the image excerpt/15 * function 
maximum/number of pixels over the width of the image excerpt, and 

a decrease in the function values after the maximum has a value of greater 
than (function maximum - function minimum)/2. 

2) (Amended) The method according to claim 1 , further comprising the step 

of: 

determining, in order to ascertain a left-hand edge of a line, said brightness 
distribution of a captured image excerpt along a horizontal and a function obtained in 
this way represents a beginning of a line by an abrupt rise in said function value. 

3) (Amended) A method according to claim 1 , further comprising the step of 
determining, after a position of a line has initially been ascertained, a further profile 
of said line by evaluating information concerning text characters recognized. 

REMARKS 

The present Amendment revises the specification and claims to conform to 
United States patent practice, before examination of the present PCT application in 
the United States National Examination Phase. Pursuant to 37 CFR 1.125 (b), 
applicants have concurrently submitted a substitute specification, excluding the 
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claims, and provided a marked-up copy. All of the changes are editorial and 
applicant believes no new matter is added thereby. The amendment, addition, 
and/or cancellation of claims is not intended to be a surrender of any of the subject 
matter of those claims. 

Early examination on the merits is respectfully requested. 
Submitted by, 





A. Robinson 
>chiff Hardin & Waite 
Patent Department 
6600 Sears Tower 
233 South Wacker Drive 
Chicago, Illinois 60606-6473 
(312) 258-5779 
Attorneys for Applicant 

CUSTOMER NUMBER 26574 



(Reg. No. 31,870) 
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Appendix A 
Mark Ups for Claim Amendments 

This redlined draft, generated by CompareRlte (TM) - The Instant Redliner, shows 
5 the differences between - 

original document : Q:\DOCUMENTS\YEAR 2001\P010104-AIGNER-POSITION 
OF TEXT LINESXORIGINAL CLAIMS.DOC 

and revised document: Q:\DOCUMENTS\YEAR 2001\P010104-AIGNER-POSmON 
OF TEXT LINES\AMENDED CLAIMS.DOC 

10 

CompareRite found 36 chan9e(s) in the text 

Deletions appear as Overstrike text surrounded by 0 
Additions appear as Bold-Underline text 

15 

O 1 ) rMethod K Amended) A method for determining the position of text lines in 

m text recognition tasks, [wh e r e by th e I comprising the steps of: 

Oj determining a brightness distribution of an acquired image excerpt along 

4; fthej a vertical [is d e t e rmin e d] by histogram formation along fthe} said Iinesfran4 

P this}; 

SI smoothing said brightness distribution is smoothed [, wh e r e by] ; 

O determining a maximum value and a minimum value of fthe} a function 

n obtained in this way [ar e determin e d,] ; and 

calculating thresholds that serve as {the} a basis for distinguishing between 
25 text line and text interspace {are} calculated based on [th e basis of] these extremes{T 
charact e riz e d in that} ; 

ascertaining a line interspace [is asc e rt ai n e d} when fttte} said function has a 
combination of a maximum with a minimum in which {the} said minimum has a value 
of less than 

30 function minimum + number of pixels over the width of the image excerpt/1 5 + 

2*number of pixels over the width of the image excerpt/15 * function 
maximum/number of pixels over the width of the image excerpt, and 
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{the} a decrease in the function values after the maximum has a value of 
greater than (function maximum - function minimum)/2. 

2) rM e thocn (Amended) The method according to [on e of the Claims 1 , 
5 character i zed in that] claim 1, further comprising the step of: 

determining, in order to ascertain fthe} a left-hand edge of a line, fthe} said 
brightness distribution of a captured image excerpt along fthe} a horizontal \\s 
d e termin e d] and {the} a function obtained in this way represents fth^ a beginning of 
a line by an abrupt rise in fthe} said function value. 

10 

^ 3) rMethod] (Amended) A method according to [one of Cl ai m s 1o r 2 , 

Q charact e riz e d in that aft e r the] claim 1, further comprising the step of 

[II determining, after a position of a line has initially been ascertained, {the} a further 

profile of fth^ said line [is determined] by evaluating fthe} information concerning 
!5 [the} text characters recognized. 
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SPECIFICATION 
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METHOD FOR DETERMINING THE POSITION OF TEXT LINES IN TEXT 

RECOGNITION TASKS 

5 BACKGROUND OF THE INVENTION 

Background of the Invention 

[0001] The invention relates to a method for determining the position of text 
lines in text recognition tasks in which the brightness distribution of an acquired 
image excerpt along the vertical is detemnined by histogram formation along the 
10 lines, and this brightness distribution is smoothed. A maximum value and minimum 
value of the function obtained in this way are determined, and thresholds that serve 
as the basis for distinguishing between text line and text interspace are calculated 
on the basis of these extremes. 

Field of the Invention 

15 [0002] In the case of the automatic recognition of texts, that is to say in the 
case of the conversion of the graphical information of a document into text 
characters which can be further processed by means of electronic text processing 
programs, an essential prerequisite for a successful recognition operation is that the 
position and the size of the individual characters be determined accurately. This 

20 presupposes in turn that the position and the dimensions of the text lines be known. 

[0003] In the case of manually guided readers, moreover, the profile of the 
text lines in the captured image excerpt turns out to be non-linear. In this context, 
there is a need to determine the profile of a text line. 

[0004] A method of the species initially cited is disclosed by EP 0702 329 A2. 
25 This publication discloses a method and an apparatus for determining the line 
course given handwritten documents. According to this publication, the picture 
elements are summed up line-by-line, smoothed and analysed for the determination 
of the position of the lines. 
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SUMMARY OF THE INVENTION 
[0005] The invention is based on the object of improving this method. 

[0006] This is done according to the invention by a method of the type 
mentioned in the introduction in which a line interspace is identified yNhen the 
5 function comprises a combination of a maximum with a minimum. The minimum 
comprises a value less than function minimum + plurality of picture elements over 
the width of the image excerpt/15 + 2*plurality of the picture elements over the width 
of the image excerpt/ 15 * function maximum / plurality of picture elements over the 
width of the image excerpt and the drop off of the function values after the maximum 
10 comprises a value greater than (function maximum - function minimum)/2. This 
embodiment has proven itseif in practice on the basis of very good results. 

[0007] An advantageous refinement of the method is provided in which, in 
order to ascertain the left-hand edge of a line, the brightness distribution of a 
captured image excerpt along the horizontal is determined and the function obtained 

15 in this way represents the beginning of a line by an abrupt rise in the function value. 
The beginning of a line can thus be determined in a simple manner with little 
complexity. Furthermore, for the determination of the position of the text lines, it can 
be ensured that in this case only images which actually contain text lines are taken 
into consideration and a user error, such as e.g., positioning the reading pen too far 

20 to the left of the beginning of a line, does not influence the determination of the line. 

[0008] It is expedient if, after the position of a line has initially been 
ascertained, the further course of the line is determined by evaluating the 
information concerning the text characters recognized. Evaluating the results of the 
character classification enables the line profile to be determined particularly 
25 accurately. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] The invention is explained in more detail with reference to the following 

exemplary figures. 

[001 0] Figure 1 is a diagram of a screen shot showing a text excerpt of the 
30 kind that is typically captured by a manually guided reader, and also the histogram 
determined from it; and 
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[001 1] Figure 2 shows the filtered histogram with the parameters entered for 
the assessment of the image, 

DETAILED DESCRIPTION OF THE INVENTION 

[001 2] The sequence of the method according to the invention is as follows: 

5 [0013] A line histogram is determined for the captured image excerpt. In this 
case, for each line, the values of all the pixels of this line (0 for white and 1 for black) 
are summed. The result is a function f(y) with 



[0014] fiy)^ ^{BlackPixel) where: 



[001 5] y denotes the line index of the image; and 

10 [001 6] Width indicates the width (number of columns) of the image excerpt. 

[0017] When a text is present, this function has a typical profile as illustrated 
by way of example in Figure 1 . in a further step, filtering is carried out in accordance 
with 

+5 



[0018] 



f\y) = ^^^^ 



/=-5 

15 [0019] where: 

[0020] y index in the line histogram; 

[0021] G weighting corresponding to an exponential smoothing curve; and 
[0022] i index of the smoothing curve. 

[0023] During the filtering operation, values are also determined for the 
2 0 absolute maximum Vafuemax i.e., the number of black pixels of the darkest line and 
the absolute minimum Valuemin i.e., the number of black pixels in the brightest line. 

[0024] Parameters for the assessment of the image are derived from these 
two values. These parameters are: 
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[0025] Trough limit = {Valuemax - Valuemin)/2 

[0026] but at least number of pixels over the width of the image excerpt/30 

[0027] Minima edge = Valuemin + number of pixels over the width of the 
image excerpt/1 5 , 

5 [0028] but at most 2* number of pixels over the width of the image excerpt/1 5 

[0029] Minima threshold = minimum edge + (2*number of pixels over the 
width of the image excerpt/15 * (Valuemax/number of pixels over the width of the 
image excerpt)) , 

[0030] but at most 3* number of pixels over the width of the image excerpt/15, 

10 [0031] Using the function f (y) and the threshold values determined, as are 
illustrated by way of example in Figure 2, the captured image is then assessed with 
regard to the presence of text lines and line interspaces. 

[0032] For this purpose, the curve profile is examined to see whether values 
which are smaller than the parameter minima threshold are present. If this is the 
15 case, then the relevant area is qualified as a valid minimum and thus as a possible 
line interspace. 

[0033] An actual line interspace is present, however, only when the presence 
of a text line is indicated by an adjoining maximum with a certain characteristic 
value. These valid maxima are defined by a subsequent decreasing of the curve 
20 value by a magnitude > Trough limit, 

[0034] The coincidence of a valid maximum with a valid minimum 
characterizes the transition from a text line to a line interspace. The parameter 
Minima edge serves for accurately determining this transition. 

[0035] The point at which the curve intersects this threshold between a valid 

25 maximum and a valid minimum is defined as a line edge. 

[0036] In order to determine the left-hand edge of a line, a column histogram 
is created in accordance with 

Height-l 

[0037] /W= ^{BlackPixel) 

i=Q 
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[0038] where 

[0039] X column index of the image excerpt; and 

[0040] Height image height 

[0041] in words the colour information of the pixels of each column of the 
5 captured image excerpt is summed. The left-hand text edge is defined (given the 
presence of at least one line) by an abrupt rise in the function value f(x). 

[0042] The follow-up plotting of the lines (i.e., the information concerning the 
further profile of the lines, which is important particularly in the case of manually 
guided readers on account of the fluctuations that occur with the latter) is effected on 
10 the basis of the position of the recognized characters. 

[0043] For this purpose, the recognized characters are classified into the 
following size groups: 

[0044] Small characters (for example "a") 0.7*rme height; 

[0045] Large characters (for example "A","g") line height; 

15 [0046] Oversize characters (for example "[""il 'i*^^ height +0.3*line 
height (descenders); 

[0047] Special characters: the characters cannot be unambiguously assigned 
by size. 

[0048] The following character groups are differentiated for the determination 
20 of the new lower edge of the text line: 

[0049] Baseline characters (for example "A", "."): the lower edge of the 
character corresponds to the lower edge of the text line, irrespective of the size of 
the character; 

[0050] Descender characters (for example "g", "["): the lower edge of the 

2 5 character corresponds to the descender boundary, irrespective of the size of the 
character; 

[0051] Special characters: these characters cannot be unambiguously 

assigned with regard to their lower edge. 
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[0052] On the basis of these assignments and a probability value G relating to 
the correct classification of the character, this probability value being obtained in the 
course of the classification method, the new line height Height is then determined as 
follows: 

5 [0053] G = Probability * CYC_MAX_WEIGHT 

CYC_MAX_EXTRPAR-I 

^ OldHeight[i] + NewHeight * G 



[0054] ^, Height^ 



CYC MAX EXTRPAR + G 



[0055] G * weighing of the line height derived from the current 

character; 

[0056] Probability probability of correct character classification (range of 
10 values between 0 and 1 ); 

[0057] CYC_MAX_WEIGHT maximum weighing of the new character 

position (for example: 5); 

[0058] Height subsequently plotted line height (upper case letter height); 

[0059] CYC_MAX_EXTRPAR size of the ring buffer for the averaging (for 
15 example: 3); 

[0060] OldHeightQ ring buffer; 

[0061] NewHeight line height derived from the current character (upper case 

letter height); and 

[0062] i index in the ring buffer. 

2 0 [0063] The profile of the lower edge of the text line is determined in 
accordance with: 



[0064] G = probability + 

[0065] Increase = 



1 ^ 



[0066] Base = NewBase + 



I, CYC_MAX_WEIGHT 
Oldlncrease + Newlncrease * G 

Increase * DeltaX + 50 



*CYC MAX WEIGHT 



100 



2 5 [0067] G weighing of the new character position; 
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[0068] Probability probability of correct character classification; 

[00691 CYC_MAX_WEIGHT maximum weighting of the new character 

position (for example; 5); 

[0070] Increase subsequently plotted current gradient of the baseline 

in %; 

[00711 Oldlncrease previous gradient of the baseline in %; 

[0072] Newlncrease gradient of the base line in % calculated 

from the position of the current character; 

[0073] Base subsequently plotted baseline position (rounded to an 

integer value); 

[0074] NewBase baseline position calculated from the position of the 

current character; and 

[0075] DeltaX X-separation in the image between the two centre points 

of the characters extracted last. 

[0076] The "Increase" is limited by the plausibility limit 
CYC_MAX__LiNEOFFSET (in the Pocket Reader: 15%). 

[0077] The above-described method is illustrative of the principles of the 
present invention. Numerous modifications and adaptations will be readily apparent 
to those skilled in this art without departing from the spirit and scope of the present 
invention. 
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ABSTRACT 

[0078] A method for determining the position of text lines in text recognition 
tasks as specified in which the brightness distribution of a captured image excerpt 
along the vertical is determined and this brightness distribution is filtered. In the 
method, maxima and minima of the function obtained in this way are determined 
and, on the basis of these extrema, threshold values are calculated which serve as a 
basis for distinguishing between text line and line interspace. The method can be 
used parficulariy advantageously in the case of manually guided electronic readers. 
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This redlined draft, generated by CompareRite (TM) - The Instant Redliner, shows 
the differences between - 

original document : Q:\DOCUMENTS\YEAR 2001\P010104.AIGNER-POSITION 
OF TEXT LINES\ORIGINAL SPECIFICAT10N.DOC 

5 and revised docunnent: Q:\DOCUMENTS\YEAR 2001\P010104-AIGNER-POSITION 
OF TEXT LINES\SUBSTITUTE SPECIFICATI0N.DOC 

CompareRite found 91 change(s) in the text 

10 Deletions appear as Overstrike text surrounded by Q 
Additions appear-as Bold-Underline text 

[M e thod for d e t e rm i ning th e po s ition of t e xt lin e s in t e xt recognition task s 

ISPECIFICATION 
15 TITLE 

METHOD FOR DETERMINING THE POSITION OF TEXT LINES IN TEXT RECOGNITION TASKS 

BACKGROUND OF THE INVENTION 

Background of the Invention 

fOOOn The Invention relates to a nnethod for determining the position of text lines in text 

2 0 recognition tasl<s [, wher e by] in which the brightness distribution of an acquired image excerpt along 
the vertical is detemnined by histogram formation along the lines, and this brightness distribution is 
smoothed r, wh e r e by] , A maximum value and minimum value of the function obtained in this way are 
determined, and thresholds that serve as the basis for distinguishing between text line and text 
interspace are calculated on the basis of these extremes. 

25 Field of the Invention 

f00021 In the case of the automatic recognition of texts, that is to say in the case of the 

conversion of the graphical information of a document into text characters which can be further 
processed by means of electronic text processing programs, an essential prerequisite for a successful 
recognition operation is that the position and the size of the individual characters be determined 
30 accurately. This presupposes in turn that the position and the dimensions of the text lines be known. 

f00031 In the case of manually guided readers, moreover, the profile of the text lines in the 

captured image excerpt turns out to be non-linear, in this context, there is a need to determine the 
profile of a text line. 
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[00041 A method of the species initially cited is disclosed by EP 0702 329 A2, This 

publication discloses a method and an apparatus for determining the line course given handwritten 
documents. According to this publication, the picture elements are summed up line-by-iine, smoothed 
and analysed for the determination of the position of the lines. 

5 SUMMARY OF THE INVENTION 

fOOOSl The invention is based on the object of improving this method. 

[0006} This is done according to the invention by [m e an s of) a method of the type mentioned 

in the introduction [wh e r e in] In which a line interspace is identified when the function comprises a 
combination of a maximum with a minimum f, wh e reby th e l . The minimum comprises a value less 
1 0 than function minimum + plurality of picture elements over the widtti oftiie image excerpt/15 + 
2*plurality ofttie picture elements over tfie width of the image excerpt/ 15* function maximum / 
plurality of picture elements over the width of the image excerpt and the drop off of the function values 
after the maximum comprises a value greater than (function maximum - function minimum)/!. This 
embodiment has proven itself in practice on the basis of very good results. 

1 5 [Advantag e is afford e d by al fOOOTI An advantageous refinement of the method [w here in] is 
provided in which, in order to ascertain the left-hand edge of a line, the brightness distribution of a 
captured image excerpt along the horizontal is determined and the function obtained in this way 
represents the beginning of a line by an abrupt rise in the function value. The beginning of a line can 
thus be determined In a simple manner with little complexity. Furthermore, for the determination of the 

20 position of the text lines, it can be ensured that in this case only images which actually contain text 
lines are taken into consideration and a user error, such as e.g.^ positioning the reading pen too far to 
the left of the beginning of a line, does not influence the determination of the line. 

[00081 It is expedient if^ after the position of a line has initially been ascertained, the further 

course of the [ s aid] line is determined by evaluating the information concerning the text characters 
25 recognized. Evaluating the results of the character classification enables the line profile to be 
determined particularly accurately. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[00091 The invention is explained in more detail with reference to [figur es , in which, by way 

of example: 

30 tthe following exemplary fi gures. 

[00101 Figure 1 [ s how s ] Is a diagram of a screen shot showing a text excerpt of the kind 

that is typically captured by a manually guided reader, and also the histogram determined [th e r e from] 
from it; and 

[00111 Figure 2 shows the filtered histogram with the parameters entered for the assessment 

35 of the image. 
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DETAILED DESCRIPTION OF THE INVENTION 

The sequence of the method according to the invention is as follows: 



[00131 A line histogram is determined for the captured image excerpt. In this case, for each 

line, the values of all the pixels of this line (0 for white and 1 for black) are summed. The result is a 
function f(y) with 



mdth 



rooi4i /(^) = 2 (BlackPixel) I where: 



I 



rooi6i 

f 001 71 



y denotes the line index of the image ; and 

Width indicates the width (number of columns) of the image excerpt. 

When a text is present, this function has a typical profile as illustrated by way of 



10 example in Figure 1 . in a further step, filtering is carried out in accordance with 

+5 



S(/(^+0*G(0) 



/•w = 



i=-5 



+5 



j=-5 
where: 

y index in the line histogram; 

G weighting corresponding to an exponential smoothing curve ; and 
i index of the smoothing curve. 



[00181 

[00191 
[00201 
[00211 
15 [00221 

[00231 During the filtering operation, values are also determined for the absolute maximum 

Valuemax i.e.i the number of black pixels of the darkest line and the absolute minimum Valuemin l.e.^ 
the number of black pixels in the brightest line [ar e a l s o d e t e rmin e d. 

k 

2 0 [00241 Parameters for the assessment of the image are derived from these two values. fPhe 
said] These parameters are: 

[00251 Trough limit = {Valuemax - Valuemin)/2 

[0026} but at least number of pixels over the width of the image excerpt/30 

[00271 Minima edge = Valuemin + number of pixels over the width of the image excerpt/15 

25 [0028 J but at most 2* number of pixels overthe width of the image excerpt/15 

[00291 Minima threshold - minimum edge + (2*number of pixels over the width of the image 

excerpt/15 * (Valuemax/number of pixels overthe width of the image excerpt)) 
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[00301 but at most number of pixels over the width of the image excerpt/15.^ 

[00311 Using the function f (y) and the threshold values determined, as are illustrated by way 

of example in Figure 2, the captured image is then assessed with regard to the presence of text lines 
and line interspaces. 

5 [00321 For this purpose, the curve profile is examined to see whether values which are 

smaller than the parameter minima threshold are present. If this is the case, then the relevant area is 
qualified as a valid minimum and thus as a possible line Interspace. 

[00331 An actual line interspace is present, however, only when the presence of a text line is 

indicated by an adjoining maximum with a certain characteristic value. These valid maxima are 
1 0 defined by a subsequent decreasing of the curve value by a magnitude > Trough limit. 

[0034] The coincidence of a valid maximum with a valid minimum characterizes the 

transition from a text line to a line interspace. The parameter Minima edge serves for accurately 
determining this transition. 

[00351 The point at which the curve intersects this threshold between a valid maximum and a 

15 valid minimum is defined as a line edge. 

[0036] In order to determine the left-hand edge of a line, a column histogram is created in 

accordance with 



[00371 



Height H 

/W= Yi{BlackPixel)m 



[00381 where 
20 [00391 X column [x ...columnl index of the image excerpt ; and 

[00401 Height [... i mag e ] image height 

[00411 in words the colour information of the pixels of each column of the captured image 

excerpt is summed. The left-hand text edge is defined (given the presence of at least one line) by an 
abrupt rise in the function value f(x). 

2 5 [00421 The follow-up plotting of the lines [, that is to sa y] (i.e., the information concerning the 

further profile of the lines, which Is important particularly in the case of manually guided readers on 
account of the fluctuations that occur with the latterHi is effected on the basis of the position of the 
recognized characters. 

[00431 For this purpose, the recognized characters are classified into the following size 

30 groups: 

[00441 Small characters (for example "a") 0.7*line height; 

[00451 Large characters (for example "A","g") 'ine height; 

[00461 Oversize characters (for example "[",T) ^i^e height +0.3*tlne height 

(descenders); 
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Special characters: the characters cannot be unambiguously assigned by size. 



fOQ481 The following character groups are differentiated for the determination of the new 

lower edge of the text line: 

f00491 Baseline characters (for example "A". "."): the lower edge of the character 

5 corresponds to the lower edge of the text line, irrespective of the size of the character; 

[0050] Descender characters (for example "g", "f)' the lower edge of the character 

corresponds to the descender boundary, irrespective of the size of the character; 

[00511 Special characters: these characters cannot be unambiguously assigned with regard 

to their lower edge. 

^0 {00521 On the basis of these assignments and a probability value G relating to the correct 

classification of the character, [the s aid] this probability value being obtained in the course of the 
classification method, the new line height Height is then determined as follows: 



[00531 

[00541 

15 [00551 
[00561 

[00571 

20 [00581 
[00591 
[00601 
100611 

25 [00621 
[00631 
[00641 



G = Wahrscheinlichkeit'^CYC^MAK^WElGm 

CYC_MAX_EXTRPAR 

J] OldHeight[i] + NewHeight * G 

1=0 



Height = - 
G 

Probability 



I 



CYC_MAX_ EXTRPAR + G 
weighing of the line height derived from the current character; 

probability of correct character classification (range of values between 
Oand 1)1 



CYC_MAX_WE1GHT maximum weighing of the new character position (for 
example: 5)i 

Height subsequently plotted line height (upper case letter height); 

CYC_MAX„EXTRPAR size of the ring buffer for the averaging (for example: 3)i 
OldHelghtQ ring buffer; 

NewHeight line height derived from the current character (upper case letter 
height) ; and 

i index in the ring buffer. 

The profile of the lower edge of the text line is determined in accordance with: 



Wahrscheinlichkeit + 



1 



V 



30 [00651 



Increase = 



CYC_MAX_ WEIGHT 
Oldlncrease + Newlncrease * G 



*CYC MAX WEIGHT 



I 



I 
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rnncfti n xr u Increase"^ DeltoX 
[00661 Base = NewBase H- 

100 

[00671 <3 weighing of the new character position! 

[00661 Probability probability of correct character classification! 

IQ0691 CYC_MAX_WEIGHT maximum weighting of the new character position (for 

example: 5)i 

100701 Increase subsequently plotted cun-ent gradient of the baseline in %; 

[00711 ^ ' Oldlncrease previous gradient of the baseline in %i 

100721 Newlncrease gradient of the base line In % calculated from the position of the 

current character; 

£00731 Base subsequently plotted baseline position (rounded to an integer value); 

£00741 NewBase baseline position calculated from the position of the current character; 

and 

£00751 DeltaX X-separation in the image between the two centre points of the 

characters extracted last. 

£00761 The "Increase" is limited by the plausibility limit CYC_MAX_LINEOFFSET (in the 

Pocket Reader: 15%). 

[Ab s tract 

}£00771 The above-described method is illustrative of the principles of the present 

invention. Numerous modificatio ns and adaptations will be readily apparent to those skilled in 
this art without depart ing from the spirit and scope of the present invention. 
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ABSTRACT 

£00781 A method for determining the position of text lines in text recognition tasks as 

specified in which the brightness distribution of a captured image excerpt along the vertical is 
determined and this brightness distribution is filtered f, in which l . In the method, maxima and minima 
of the function obtained in this way are determined and, on the basis of these extrema, threshold 
values are calculated which serve as a basis for distinguishing between text line and line interspace. { 

JThe method can be used particularly advantageously in the case of manually guided electronic 
readers. 
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Method for determining the position of text lines in text 
recognition tasks 

The invention relates to a method for determining the position 
of text lines in text recognition tasks ^ whereby the 
5 brightness distribution of an acquired image excerpt along the 
vertical is determined by histogram formation along the lines ^ 
and this brightness distribution is smoothed, whereby maximum 
value and minimum value of the function obtained in this way 
are determined, and thresholds that serve as the basis for 
10 distinguishing between text line and text interspace are 
calculated on the basis of these extremes. 



In the case of the automatic recognition of texts, that is to 
say in the case of the conversion of the graphical information 
of a document into text characters which can be further 
15 processed by means of electronic text processing programs, an 
essential prerequisite for a successful recognition operation 
is that the position and the size of the individual characters 
be determined accurately. This presupposes in turn that the 
position and the dimensions of the text lines be known. 

20 In the case of manually guided readers, moreover, the profile 
of the text lines in the captured image excerpt turns out to 
be non-linear. In this context, there is a need to determine 
the profile of a text line. 



A method of the species initially cited is disclosed by EP 
25 0702 329 A2 , This publication discloses a method and an 

apparatus for determining the line course given handwritten 
documents. According to this publication, the picture 
elements are summed up line-by-line, smoothed and analyzed for 
the determination of the position of the lines . 



3 0 The invention is based on the object of improving this method. 
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This is done according to the invention by means of a method 
of the type mentioned in the introduction wherein a line 
interspace is identified when the function comprises a 
combination of a maximum with a minimum, whereby the minimum 
5 comprises a value less than function minimum -h plurality of 
picture elements over the width of the image excerpt/15 + 
2*plurality of the picture elements over the width of the 
image excerpt / 15 * function maximum / plurality of picture 
elements over the width of the image excerpt and the drop off 
10 of the function values after the maximum comprises a value 
greater than (function maximum - function minimum) /2 , This 
embodiment has proven itself in practice on the basis of very 
good results . 

Advantage is afforded by a refinement of the method wherein in 
15 order to ascertain the left-hand edge of a line, the 

brightness distribution of a captured image excerpt along the 
horizontal is determined and the function obtained in this way 
represents the beginning of a line by an abrupt rise in the 
function value. The beginning of a line can thus be determined 
2 0 in a simple manner with little complexity. Furthermore, for 

the determination of the position of the text lines, it can be 
ensured that in this case only images which actually contain 
text lines are taken into consideration and a user error, such 
as e.g. positioning the reading pen too far to the left of the 
25 beginning of a line, does not influence the determination of 
the line. 

It is expedient if after the position of a line has initially 
been ascertained, the further course of the said line is 
determined by evaluating the information concerning the text 
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characters recognized- Evaluating the results of the 
character classification enables the line profile to be v 



determined particularly accurately. 

5 The invention is explained in more detail with reference to 
figures^ in which, by way of example: 

Figure 1 shows a text excerpt of the kind that is typically 
captured by a manually guided reader^ and also the histogram 
determined therefrom and 
10 Figure 2 shows the filtered histogram with the parameters 
entered for the assessment of the image. 

The sequence of the method according to the invention is as 
follows : 

15 A line histogram is determined for the captured image 

excerpt. In this case, for each line, the values of all the 
pixels of this line (0 for white and 1 for black) are summed. 
The result is a function f (y) with 



25 When a text is present, this function has a typical profile 
as illustrated by way of example in Figure 1. In a further 
step, filtering is carried out in accordance with 
+5 



Width-l 



f(y)= Y^iBlackPixel) 



where 



20 



y 

Width 



denotes the line index of the image 

indicates the width (number of columns) of the 

image excerpt 




z=-5 



where 



30 



y 



index in the line histogram 
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G weighting corresponding to an exponential smoothing 

curve 

i index of the smoothing curve 

During the filtering operation, the absolute maximum Valuemax 
i.e. the number of black pixels of the darkest line and the 
absolute minimum Valuemin i.e. the number of black pixels in 
the brightest line are also determined. 

Parameters for the assessment of the image are derived from 
these two values. The said parameters are: 

Trough limit = (Valuemax - Valuemin) / 2 

but at least number of pixels over the width of the Image 
excerpt/30 

Minima edge = Valuemin -h number of pixels over the width of 
the Image excerpt/15 

but at most 2'^number of pixels over the width of the Image 
excerpt/15 

Minima threshold = minimum edge + (2^number of pixels over 
the width of the image excerpt/15 ^ (Valuemax/ number of 
pixels over the width of the image excerpt) ) 
but at most 3-^ number of pixels over the width of the image 
excerpt/15 

Using the function f (y) and the threshold values determined, 
as are illustrated by way of example in Figure 2, the 
captured image is then assessed with regard to the presence 
of text lines and line interspaces. 

For this purpose, the curve profile is examined to see 
whether values which are smaller than the parameter minima 
threshold are present. If this is the case, then the relevant 
area is qualified as a valid minimum and thus as a possible 
line interspace . 
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An actual line interspace is present^ however, only when the 
presence of a text line is indicated by an adjoining maximum 
with a certain characteristic value. These valid maxima are 
defined by subsequent decreasing of the curve value by a 
5 magnitude > Trough limit. 

The coincidence of a valid maximum with a valid minimum 
characterizes the transition from a text line to a line 
interspace. The parameter Minima edge serves for accurately 
10 determining this transition. 

The point at which the curve intersects this threshold 
between a valid maximum and a valid minimum is defined as a 
line edge. 

15 

In order to determine the left-hand edge of a line, a column 
histogram is created in accordance with 

H eigkt -l 

/(x)- Y^{BlackPixel) 

i=0 

20 X column index of the image excerpt 

Height . . . .image height 

in words the colour information of the pixels of each column 
of the captured image excerpt is summed. The left-hand text 
25 edge is defined (given the presence of at least one line) by 
an abrupt rise in the function value f (x) . 

The follow-up plotting of the lines, that is to say the 
information concerning the further profile of the lines, 
30 which is important particularly in the case of manually 

guided readers on account of the fluctuations that occur with 
the latter, is effected on the basis of the position of the 
recognized characters . 

35 For this purpose, the recognized characters are classified 
into the following size groups: 
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Small characters (for example '"a") 
Large characters (for example 



g-) 



0. Valine height 
line height 



Oversize characters (for example line height 

+0.3*line height (descenders) 
5 Special characters: the characters cannot be unambiguously 
assigned by size. 

The following character groups are differentiated for the 
determination of the new lower edge of the text line: 

10 

Baseline characters (for example "A", ''."): the lower edge of 
the character corresponds to the lower edge of the text line^ 
irrespective of the size of the characters- 
Descender characters (for example "'g'\ "[''): the lower edge 
15 of the character corresponds to the descender boundary, 
irrespective of the size of the characters- 
Special characters: these characters cannot be unambiguously 
assigned with regard to their lower edge. 

20 On the basis of these assignments and a probability value G 
relating to the correct classification of the character, the 
said probability value being obtained in the course of the 
classification method, the new line height Height is then 
determined as follows: 

25 

G = Probability * CYC_MAX_WEIGHT 



CYC_MAX_EXTRPAR-1 



OldHeight[i] + NewHeight ^ G 



Height = 



CYC_MAX EXTRPAR + G 



30 



weighing of the line height derived 



from the current character 

Probability probability of correct character 

classification (range of values between 0 and 1) 
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CYC_MAX_WEIGHT inaximum weighing of the new 

character position (for example: 5) 

Height subsequently plotted line height 

(upper case letter height) 
5 CYC_MAX_EXTRPAR size of the ring buffer for the 

averaging (for example: 3) 
01dHeight[] ring buffer 

NewHeight line height derived from the current 

character (upper case letter height) 
10 i index in the ring buffer 

The profile of the lower edge of the text line is determined 
in accordance with: 



15 G = 



20 



^ 1 ^ 
Probability + 

CYC_MAX_WEIGHT 
Oldlncrease + Newlncrease * G 



=^CYC MAX WEIGHT 



Increase - 



Base - NewBase + 



1 + G 

Increase * DeltaX + 50 
100 



G weighing of the new character position 

Probability probability of correct character 

classification 

CYC_MAX_WEIGHT maximum weighting of the new character 

25 position (for example: 5) 

Increase subsequently plotted current gradient of 

the baseline in % 

Oldlncrease previous gradient of the baseline in % 

Newlncrease gradient of the base line in % calculated 

30 from the position of the current character 

B^se subsequently plotted baseline position 

(rounded to an integer value) 

NewBase baseline position calculated from the 

position of the current character 
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DeltaX X-separation in the image between the two 

centre points of the characters extracted last. 

The ^^Increase" is limited by the plausibility limit 
5 CyC_MAX_LINEOFFSET (in the Pocket Reader: 15%) . 
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New Patent Claims 

1) Method for determining the position of text lines in text 
recognition tasks, whereby the brightness distribution of an 
acquired image excerpt along the vertical is determined by 

5 histogram formation along the lines, and this brightness 

distribution is smoothed, whereby maximum value and minimxim 
value of the function obtained in this way are determined, and 
thresholds that serve as the basis for distinguishing between 
text line and text interspace are calculated on the basis of 

10 these extremes, characterized in that a line interspace is 

ascertained when the function has a combination of a maximum 
with a minimum in which the minimiam has a value of less than 
function minimiam + number of pixels over the width of the 
image excerpt/15 + 2*number of pixels over the width of the 

15 image excerpt/15 * function maximum/ number of pixels over the 
width of the image excerpt, and 

the decrease in the function values after the maximum has a 
value of greater than (function maximum - function minimum) /2. 

2) Method according to one of the Claims 1, characterized in 
2 0 that in order to ascertain the left-hand edge of a line, the 

brightness distribution of a captured image excerpt along the 
horizontal is determined and the function obtained in this way 
represents the beginning of a line by an abrupt rise in the 
function value. 

25 3) Method according to one of Claims lor 2, characterized in 
that after the position of a line has initially been 
ascertained, the further profile of the said line is 
determined by evaluating the information concerning the text 
characters recognized. 
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Abstract 

A method for determining the position of text lines in text 
recognition tasks as specified in which the brightness 
5 distribution of a captured image excerpt along the vertical 
is determined and this brightness distribution is filtered, 
in which maxima and minima of the function obtained in this 
way are determined and, on the basis of these extrema, 
threshold values are calculated which serve as a basis for 
10 distinguishing between text line and line interspace. 

The method can be used particularly advantageously in the 
case of manually guided electronic readers. 
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DECLARATION AND POWER OF ATTORNEY FOR PATENT APPLICATION 
ERKLARUNG FUR PATENTANMELDUNGEN MIT VOLtl^MPHT 
German Language Declaration 



Als nachstehend benannter Erfinder erklare ich hiermit 
an Eides Statt: 

dass mein Wohnsitz, meine Postanschrift, und meine 
Staatsangehorigkeit den im Nachstehenden nach 
meinem Namen aufgefuhrten Angaben entsprechen, 

dass ich, nach bestem Wissen der ursprungliche, erste 
und alleinige Erfinder (falls nachstehend nur ein Name 
angegeben ist) oder ein ursprunglicher, erster und 
Miterfinder (falls nachstehend mehrere Namen 
aufgefuhrt sind) des Gegenstandes bin, fur des dieser 
^ Antrag gestellt wird und fur den ein Patent beantragt 
wird fur die Erfindung mit dem Titel: 

Verfahren Zur Bestimmung Der Lage Von Textzeilen 
Bei Texterkennungsaufgaben 

vieren Beschreibung 

f|kutreffendes ankreuzen) 

rip hier beigefugt ist. 

!b am als 

^ PCT internationale Anmeldung 

JPCT Anmeldungsnummer 

^=^ingereicht wurde und am 

Mbgeandert wurde. 

Qfch bestatige hiermit, dass ich den Inhalt der obigen 
Qfatentanmeldung einschliesslich der Anspruche 
L(^urchgesehen und verstanden habe, die eventuell 

durch einen Zusatzantrag wie oben erwahnt 

abgeandert wurde. 

Ich erkenne meine Pflicht zur Offenbarung 
irgendwelcher Informationen, die fCir die Prufung der 
vorliegenden Anmeldung in Einklang mit Absatz 37, 
Bundesgesetzbuch, Paragraph 1.56 von Wichtlgkeit 
sind, an. 

Ich beanspruche hiermit auslandische Prioritatsvorteile 
gemass Abschnitt 35 der Zivilprozessordnung der 
Vereinigten Staaten, Paragraph 119 aller unten 
angegebenen Auslandsanmeldungen fiir ein Patent 
Oder eine Erfindersurkunde, und habe auch alle 
Auslandsanmeldungen fur ein Patent oder eine 
Erfindersurkunde nachstehend gekennzeichnet, die 
ein Anmeldedatum haben, das vor dem 
Anmeldedatum der Anmeldung liegt, fur die Prioritat 
beansprucht wird. 



As a below named inventor, I hereby declare that: 



My residence, post office address and citizenship are 
as stated below next to my name. 



I believe I am the original, first and sole inventor (if only 
one name is listed below) or an original, first and joint 
inventor (If plural names are listed below) of the 
subject matter which is claimed and for which a patent 
is sought on the invention entitled 



the specification of which 
(check one) 

□ is attached hereto 

□ was filed on as 

PCT International application 

PCT Application No. 

and was amended on 



I hereby state that I have reviewed and understand the 
contents of the above identified specification, including 
the claims as amended by any amendment referred to 
above. 



1 acknowledge the duty to disclose Information which 
is material to the examination of this application in 
accordance with Title 37, Code of Federal Regulations, 
§1.56. 



I hereby claim foreign priority benefits under Title 35, 
United States Code, §119 of any foreign applicatlon(s) 
for patent or Inventor's certificate listed below and have 
also identified below any foreign application for patent 
or inventor's certificate having a filing date before that 
of the application on which priority is claimed: 
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Prior foreign applications 
Prioritat beansprucht 

A 1623/98 Austria 

(Number) (Country) 
(Numnner) (Land) 



Priority Claimed 



(Number) 
(Nummer) 



(Number) 
(Nummer) 



(Country) 
(Land) 



(Country) 
(Land) 



30 September 1998 

(Day Month Year Fiied) 
(Tag Monat Jalir eingereicint) 



(Day Montin Year Filed) 
(Tag Monat Jahr eingereicht) 



(Day Month Year Filed) 
(Tag Monat Jahr eingereicht) 



■ 


□ 


Yes 


No 


1 A 
Ja 


Nein 


□ 


□ 


Yes 


No 


Ja 


Nein 


□ 


□ 


Yes 


No 


Ja 


Nein 



* Ich beanspruche hiermit germass Absatz 35 der 
Zivilprozessordnung der Vereinigten Staaten, 
Paragraph 120, den Vorzug aller unten aufgefuhrten 
Anmeldungen und falls der Gegenstand aus jedem 
cj?rispruch dieser Anmeldung nicht in einer fruheren 
^afnerikanischen Patentanmeldung laut dem ersten 
JHaragraphen des Absatzes 35 der ZivilprozeRordnung 
5^r Vereinigten Staaten, Paragraph 122 offenbart ist, 
Mkenne ich gemass Absatz 37, Bundesgesetzbuch, 
Jffaragraph 1.56 meine Pflicht zur Offenbarung von 
Hciformationen an, die zwischen dem Anmeldedatum 
=tter fruheren Anmeldung und dem nationalen oder PCT 
Wternationalen Anmeldedatum dieser Anmeldung 
^bekannt geworden sind. 



I hereby claim the benefit under Title 35, United States 
Code. §120 of any United States applicatlon(s) listed 
below and, insofar as the subject matter of each of the 
claims of this application is not disclosed in the prior 
United States application in the manner provided by 
the first paragraph of Title 35, United States Code, 
§122 I acknowledge the duty to disclose material 
information as defined in Title 37, Code of Federal 
Regulations, §1.56 which occurred between the filing 
date of the prior application and the national or PCT 
international filing date of this application. 



J{^pplication Serial No.) 
^fXnmeldeseriennummer) 



(Filing Date) 
(Anmeldedatum) 



(Application Serial No.) 
(Anmeldeseriennummer) 



(Filing Date) 
(Anmeldedatum) 



(Status) 

(patentiert, anhangig, 
aufgegeben) 



(Status) 

(patented, pending, 
abandoned) 



(Status) 

(patentiert, anhangig, 
aufgegeben) 



(Status) 

(patented, pending, 
abandoned) 



Ich erklare hiermit, dass alle von mir in der 
vorliegenden Ekiarung gemachten Angaben nach 
meinem besten Wissen und Gewissen der vollen 
Wahrheit entsprechen, und dass ich diese 
eidesstattliche Erklarung in Kenntnis dessen abgebe, 
dass wissentllch und vorsatzlich falsche Angaben 
gemass Paragraph 1001, Absatz 18 der 
Zivilprozessordnung der Vereinigten Staaten von 
Amerika mit Geldstrafe belegt und/oder Gefangnis 
bestraft werden koennen, und dass derartig wissentlich 
und vorsatzlich falsche Angaben die Gultigkeit der 
vorliegenden Patentanmeldung oder eines darauf 
erteilten Patentes gefahrden konnen. 



1 hereby declare that all statements made herein of my 
own knowledge are true and that all statements made 
on information and belief are believed to be true, and 
further that these statements were made with the 
knowledge that willful false statements and the like so 
made are punishable by fine or Imprisonment, or both, 
under Section 1001 of Title 18 of the United States 
Code and that such willful false statements may 
jeopardize the validity of the application or any patent 
issued thereon. 
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VERTRETJNGSVOLLMACHT: Als benannter Erfinder 
beauftrage ich hiermit den nachstehend benannten 
Patentanwalt (oder die nachstehend benannten 
Patentanwalte) und/oder Patent-Agenten mil der 
Verfolgung der vorliegenden Patentanmeldung sowie 
mit der Abwicklung aller damit verbundenen Geschafte 
vor dem Patent- und Warenzeichenamt: 



>QWEH-Off ;>^TORN^^:.^.^^,^ named inventor, I 
hereby appbim thV fdVic^j^g J^tt"ornay(s) and/or 
agent(s) to prosecute this application and transact all 
business In the Patent and Trademark Office 
connected therewith. 



And I hereby appoint all Attorneys identified by United States Patent & Trademark Office customer number 
26574, who are all members of the firm of Schiff Hardin and Waite. 



Telefongesprache bitte richten an: Direct Telephone Calls to: (name and telephone number) 

(Name und Teiefonnummer) 

312/258-5500 

Postanschrift: Send Correspondence to: 

SCHI FF HARDIN & WAITE 
-— "--"TgfENT DEPARTMENIT^ 
6600 Sears Tower, Chicago, Illinois 60606-6473 



CUSTOMER NUMBER 26574 





livelier Name des einzigen Oder ursprunglichen Erfinders: 

ciAIGNER, Walter 


Full name of sole or first inventor: 




" ;UnteFspkrift des^rfinders / 


Datum 


Inventor's signature 


Date 




;:Wohnsitz ^ 

JJnz^ Austria 


Residence 




Staatsangehorigkeit 

1 Austria 


Ali'X 


Citizenship 




f Postanschrift 

f Hoerzingerstrasse 38/1 3 


Post Office Address 




i A-4020 Linz 
= Austria 





Voller Name des zweiten Miterfinders (falls zuttreffend)- 

^ZAGLER, Bertram 


Full name of second joint inventor, if any: 


^^tJnt^rschrift des^fTinders 


Datum 


Inventor's signature 


Date 


wohnsitz/ 

Gra/ Austria 


Residence 


staatsangehorigkeit 

Austria 


kixx 


Citizenship 


Postanschrift 

Krottendorferstr. 90/3/28 


Post Office Address 


A-8052 Graz 
Austria 





(Bitte entsprechende Informationen und (Supply simiiar information and signature for 

Unterschriften im Falle von weiteren Miterfindern subsequent joint inventors), 

angeben). 



Page 3 of 3 



